Papers with domain-specific scenarios
SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to evaluate open domain dialogues have a one-to-many problem . existing approaches lack commonsense reasoning biases and perform poorly in domain-specific scenarios. |
| Approach: | They propose a framework that leverages both a small, specialised model and LLMs for the evaluation of open-domain dialogues. |
| Outcome: | The proposed framework achieves state-of-the-art performance in both classification and evaluation tasks and exhibits better correlation with human judgements. |
StructuThink: Reasoning with Task Transition Knowledge for Autonomous LLM-Based Agents (2025.findings-emnlp)
Copied to clipboard
| Challenge: | StructuThink framework enhances LLMs' ability to ground decisions in domain-specific scenarios. |
| Approach: | They propose a knowledge-structured reasoning framework that enhances LLM-based agents with explicit decision constraints. |
| Outcome: | The proposed framework achieves higher task success rates and more efficient action sequences than baseline methods. |